Well, if I’m playing the part of the diver right, in order for me to do it in the first place I’d have to have some evidence that Omega was honest. Really I only need a 10% or so chance of him being honest to pick him up. So I’d probably go “my evidence was wrong, dang, now I’m out the $5 for gas and the 3 utilons of having to ride with that jerk Omega.” This would also be new evidence that changed my probabilities by varying amounts.
So the analogy is that giving the ride to the bad AI is like helping it come into existence, and it not paying is like it doing horrible things to you anyway? If that’s the case, I might well think to myself “DOES NOT COMPUTE.”
Well, if I’m playing the part of the diver right, in order for me to do it in the first place I’d have to have some evidence that Omega was honest. Really I only need a 10% or so chance of him being honest to pick him up. So I’d probably go “my evidence was wrong, dang, now I’m out the $5 for gas and the 3 utilons of having to ride with that jerk Omega.” This would also be new evidence that changed my probabilities by varying amounts.
So the analogy is that giving the ride to the bad AI is like helping it come into existence, and it not paying is like it doing horrible things to you anyway? If that’s the case, I might well think to myself “DOES NOT COMPUTE.”